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ABSTRACT 

The 1982 British Columbia Science Assessment ' was 
designed to, gather information from the professional literature, J 
review panels, interpretation panels, teacliers, and students enrolled 
m grades 4, 8, and 12 (and a sample from grade 10). This pamphlet 
provides brief an-swers to nine questions related to the assessment. 
These questions focus on: (1) why the assessrpent was conducted; (2) 
who was involved; (3) how well student performance met provincial 
expectations in 1982; (5) a comparison of 1982 with 1978 results; (^6) 
student attitudes toward science; (7) major findings; (8) major 
recomJnendations; and, (9) uses of assessment data and results. 
Detailed achievement results, teacher (Questionnaire results, 
conclusions and recommendations are prbvided in a separate General 
Report. Highlights of the assessment^ summary tables of important 
results, and conclusions and recommendations are providecJ in separate 
Summar'y Report. (Author/JN) 
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BRITISH COLUMBIA SCIENCE 
ASSESSMENT 1982 

The 1932 British Coiurrtbia Science Assessr^ent was designed to gather 
mforoiation from the professional literature review panels tnterpretation 
oaneis teachers and pupiisenroiied in*grades4 Sand 12 land asamp^e from 
grade, I0i 

Specific purposes were 

1 To establish baseline provincial ana school district puptl achievement 
data on selected objectives rated as priorities m the current sctence 

• Curriculum guides 

2 To provide provincal and school district data on changes m pupil 
achievement on curncuium guide objectives n selected domains from the 
1978 Science Assessment 

3 To develop a bank of B C cumculum-reiated items which can be used to 
develop achievement instruments for optional use by classroom teachers 
as part of thetr pupil evaluation- 

4 To document current classroonn practices and identify significan* 
changes since the 1978 assessment 

5 To assess the extent to which change has taken place m non^ach'ievemAnt 
areas (eg faciftli^s attitudes) which wer^ identified as conceVns m 1978^ 

6 To identify the current context within which science curricula are used 

7 ^0 examine initial reactions to changes revisions uodates in science 
curricula since 1973 



This pamphlet provides 
brief answers to the 
following questions: 



WHY was this assessment 
conducted'^ 

HOW was the assessment • 
condiiCted'^ 

WHO was involved'^ 

HOW well did pupil performance 
pi.eet provincial expectations in 
1982'? ' ^ 

HO^ dofes pertormance m 1982 
compare to 1978'? 

WHAT are the attitudes of B C 
pupils towards science'' 

WHAT are the major findings of 
the Assessment? 

WHAT ^s recommended by the 
Contract Team'?- 



9 WHAT happens nexf? 



1. WHY WAS THIS ASSESSMENT CONDUCTED'> 



ERLC 




^ ci^"d ';p f' 

PERMISSION TO REPRODUCE THIS 
MATERIAL HAS BtEN GRANTED BY 



TO THE EDUCATIONAL RESOURCES ' 
INFORMATION CENTER (ERIC) 



2. HOW WAS THE ASSESSMENT 
CONDUCTED? 



MAJOR STAGER 



I April 1981 
, Contract awarded _by Ministry to 



University of Victoria Team 



May-August 1981 

Development of draft copies ot , 

• teacher questionnaires 

• pupil achievement items 

• pupil attftude items^ 







Augusf-September 1981 


Teacher Review/ Panels examine items 


and questfonnaires 









October-November 1981 

_Achigyjgmfinl_items^ttitude~surveysr^ 
and questiohnaires piloted; informatipn 
analyzed and final forms developed 



December 1981-January 1982 • 

Actiievement forms and teacher ques- 
tionnaires printed, packaged and 
distributed 





* 


February 

Teachers complete 


1982 

questionnaires'^ 



3. WHO WAS INVOLVED-? 



The 1982 Science Assessment was managed by the Learning Assessment 
Branch of , the SchQols Program Division of the Ministry of Education 

The contract for this assessment was awarded to ^team headed by Dr Hugh 
Taylor of the University of Victoria The 'Contract Team was guided by an 
Advisory.Committee made up of teachers, administrators, a school trustee, ar^d 
Ministry and Technical Agency representatives ' 

Members of the Contract Team were: 

Hugh Taylor (Chair) University of Victoria 

Robert Hunt Victoria ^ A 

John Sheppy University of Victoria ^ 

David Stronck University of Victoria , . » 

Members of the Advisory Committee were: 

Albert Hayn'es (Chair) Learning Assessment Branch 

David Bateson Learning Assessment Branch 

Mary Cooper . 8 C Researcn 

'JackCorbett AbbOtsford ^ 

Barbara Holmes BC Research ^ 

Marion'Langdale West Vancouver ' ' ' 

Alan Littler ^ Sobke 

Peter MacMilhan Barnere 

Milton McLaren Simon Fraser University 

Ernie Norlin Salmon Arm v ^ 

Tom Robinson Duncan 

Hugh Taylor ^ University of Victoria ' ' " , 

EUzal^eth Wetch-Wilson Nelson 



^The Learning Assessment.BrancVi 
would like to convey a heart-felt 
■THANK YOU' to all teachers who 
contributed m such a pfofessional 
manner to the various phases of the 
Assessment' « 




March 1982 

Pupils, in grades 4, 8 and 12 (and a 
sample from grade ^0)^ complete 



achievement forms 



AREAS OF RESPONSIBILITY .DURING THE ASSESSMENT 



April-May 1982 


Analyses of data 






0 




June 1982 

Interpretation Panels consisting of 
educators and members of the public 
)udge pupK performance levels 



July-Septerttber 1982 

. Provincial Reports prepared, reviewed, 
and'finaflized. Reports presented to the 
Ministry 



NDvem6er1982 

Publication of /epdrts ^ ' 



Ministry of Education 
Learning Assessment 
Branch 
•TERMS OF REFERENCE 

• ADVISORY COMMITTEE 

• TECHNICAL BUB-COMMITTEE 
•^'pftqVINCIAL REVIEW PANELS 

• PROVINCIAL INTERPRETATION 
PANELS - 



Contract Te^m 

• Instruments 

- achievement forms 
-affective scales 
'r teactier 
questionnaires 

♦ Reports 

: general report 
' siummary report 



J 



Technical Agency 

► Sampling 

► Instruments 

- printing 

- distributing 

- coll^pting 

* Analyzirig data 

► Consulting s*ervic6s 



4. HOW WELL DID PUPIL PERFORMANQE MEET PROVINCIAL 
EXPECTATIONS IN 1982? 



Achievement Items were distributed over the domains as Shown below • ' ^ 



DOMAIN 



Science Processes 

Knowledge — recall and Ajnderstand 

Higher Level Thinking 



Number of items at Each Grade Level 



60 
33 
15 



36 
57 
27 



12 



22 
30 
18 



Three interpretation panels, 
comprised of educators, trust- 
ees, and membersofthepubhc. 
judged»provincial performance 
on -a five-point scale 



INTERPRETATION PANELS' RATINGS OF PUPIL PERFORMANCE 

Scale ST = Strong VS ^ Very Satisfactory S^Satisfactory 



M = Marginal W ^ Weak 



DOMAIN 


Grade 4 


Grade 8 


Grade 12 


j -Objective 


Mean 

Percent^ 

Correct 


<Panel 
Rating 


Mean 

Percent 

Correct 


Panel 
Rating ^ 


Mean 
Percent 
J Correct 


Panel 
Rating 


j • SCIENCE PROCESSES 
! - Observe, and Infer 
[' - Quantify 
1 - Classify 


65^ 
75 
60 
65 


S 

VS 
M 
S 


NA*-- ^ 

NA . 
67 


• VS 


NA--- 

NA 
NA 


rvL 


- Cbmrriunicafe , , " 
' Interpret Data 

- Identify and Control Variables 


56 

NA'- 
NA 




56 
45 


— VS- y 

s 
w 


"-^NA 

^53 
57 


« 

M 
S 


• KNOWLEDGE — recall/understand 

- Concepts 

- Application/Nature of Science 

- Safety Procedures 


iL 

55 
67 
69 


It ' 
M 

S 


• 

55 
53 
50 
"66 


M • 
W 


55. 
52 

60. • 
56 


( 

M_ 
M 


• HIGHER LEVEL THINI^ING ' 

- Apply Concept? 

- Use F^ationai and Critical Thinking 


63_ 

58 

'72 . 


A. 

s • 

VS 


50 
46 


M^S 

S 

M 


49 
58 


M 
M 



H^®^"''®'^®"' Correct is the average percent of correct responses to each set of questions within the obiectiv'e or 
• opmain ^ 

domf '"^ because Panel nnembers felt there was too muQh variance across ratings of the objectives within the 
*** Not A^essed 



5. HOWDQES PERFORMANCE IN 198Z'COMPARE TO 1978? 



To determine c^^anges in pupils achievement since the 1978 Assessment, several 1978 items, classified under change 
domains, were repeated in 1 982 at each of the three grade levels By exar^ing the mean percent correct of responses to items 
tn each category, trends were identified at two grade levels. 8 and 12 NO SUCH IDENTIFICATION was made at grade 4 

•th^e^nsUumems^^ 

The Contract Team reported that overall performance in 1978 and 1982 was very similar on items repeated m Grade 8 PudiI 
performance was judged to be satisfactory in both assessments In grade 1 2. performance on repeat times is lower m 1 982 by 
less than 2% Even so, the 1982 Interpretation Panel rated the pupil performance higher i 



M 

e 

« o 
ee 

I' 

n 
I 



70 
60 
50 
40j 
30 
20 
10 
0 



Grade 8 



1978 1982 
Sciences ' 
Processes 



1978 1982 
Knowledge 



70 
60 
50 
40 
30 
20 
10 
0 



Grade 12 



1978 1982 \ 1978 1982 
Knowledge HIgber Level 
Thinking ' 



■'■"^ ATTITUDES OF B.C. PUPILS TOWARDS 

SCIENCE? , ' 



The achievement booklefs contained a number of affective scales The purpose of/Tfiese scales was twofold tn nrovido 
m f!ft 7! T^'^'T:.' use informally in assessing class attitudes'and to provfde atasX^^^^^^ 

in futureprovincial assessments Some attitude trends evident across the grades were measuring change 

• overall attitudes towards^ctence appear to be positive 

• attitude towards the study of science in school declines from Grade 4 to Grada12 

\ nnK/%no!n f Vr^^^^ appear^more positive than girls' attitudes towards science 

• only one in five Grade 12 pupils would be prepared to enter a scientific career 



7. WHAT ARE THE MAJOR FINDINGS OF THE ASSESSMENT? 



Pupils* Achievement 

• Three domain s were assessed at each of the three grade 
levels The Interpretation Panels rated pupils^perform- 
ance on two of the domains as Satisfactory, one was 
rated Marginally Satisfactory, four as Marginal and two 
received 'noratmg due to large objective rating variance 

• The lowest overall rating at each grade level was given 
to the objective Know Safety Procedures Very high 
performance was'expected but was npt attained This 
low level of performance was a particular concern to the 
Interpretation Panels 

• In Grade 4, process and thinking skills appear to-be 
•adequately developed Concepts appear to be under- 

emphasized perh^psdueto lack of time spent teaching 
science in the primary grades 

• Pupils appear to be leaving elementary school with an 
adequate scientific background in the basics but they 
are not showmg adequate ability to integrarte knowledge 
and processes 

' The Grade 12 picture is discouraging No areas of 
achievement were assessed m which it could be sajd 
that the pupils were achieving well 

As in 1978, sex-related differences in achievement 
generally favoured males Only in the process domain at 
Grade 4 dtd girls outperform boys 

"Current Grade 10 pupils and Grade 12 puprts with 
science courses beyond Grade 10. performed substan- 
tially better than Grade 1 2 pupils with no senior science 
courses 

Performance on change items showed no difference in 
achievementat Grades and a slight decline at Grade 1 2 
level 



Teacher Questionnaires 

• Many elementary and a number of junior secondary 
teachers consider themselves less than adequately 
Prepared to teach science 

• Many elementary teachers are not spending^he 
recommended time in teaching science 

• Almost one-half of all teachers surveyed expressed the 
need for extensive m-service and were willing to part- 
icipate after school hours 

• Some progress has occurred sincej1978 in the area of 
coordination, especially at the secondary level How- 
ever, one-half of the respondents still report no district 
level Coordination in science 

• Elementary teachers still report (as they did in 1978) 
dtffjculty in the general areas of facilities.and supplies. 
The situation has improved somewhat at the secondary 
level, but some problems are still being r^orted at the 
junior secondary level 

• Nearly all teachers of Biology 1 1 and 1*2 see a need for a 
curriculum revision 

Other Differences * 

• At all levels, pupils who. most commonly spoke a 
language other than English had Jower mean scores on > 
ail domains andnbjectives Differences lessen and even 
disappear with increasmg^me within the schools and 
with the introduction of English in the home 

• Pupils whose post-secondary plans included scientific 
study achieved much higher than those who planned 
further study in non-scienrtific areas 



80 
75 
70 



S Or 10 students 

Gr 12 students, no science past Gr 10 
^ Gr 12 students, Gr libutnoGr i?science' 

Gr 12 students, at least one Gr 12 science 



\ 



8. WHAT IS RECOMMENDED BY THE CONTRACT 
TEAM? 



The Contract Teams reconiPH^nddtions were spht into two 
levels those "of highest prionty and further recommendations 

t R^comn^endauons Of Highest Pncnt^, i t 



That the Prograr^ Irpif^ry^^n^et r^n Sr.mch of the M'ni<;fr^ 
Education coord /ra-*^ the cie'i^gn deveiop'ien* a^d deiwf>rv o* 
in-serYice programs ^h^ci v/-// foc.js on the fotlov^irig ateas of 
need \ . 

• hOs\ to teach scence Qroresses and crj^tcj^i thi^^k'ng sk>H^ 

' • the devolofyr^erit of an adequate bhckgrourid of ^c/c^qc 
. kno\*/{edge m areasi stressqp m the curriculum in area'i 
• weakr^ess fc ele've'^fary teachers and in the phvs'cal and 
earth spuice scie'^cQ9for lumor secondary teachers 

• how to safofy teach sc-e^ce ri 

• hQw to teach safety to pup-'s * 



[ Recommendation Y] 

That the following acudns btf ^d^en v^i*h esi'eC fv t^>e ore- 
servtce training of teachers * 

• the Faculties of Educat'uri sho.j'd rtwtse tt^a^her educaiion 
programs as needed to ensure that 

in all pre-service elemenf^y teachers e^p^'ience science 
study to a minimum of a 3-unit course or eqw/alent at the 
university college level and y 

f 'u a^f pre-se( vice elementary teachers taf^ea course >\science 
teaching methodology \ 

• the Faculties of Educ^*'on shouM gi^e greater emph)esis to 
each of tne tectjniques and tooics identified by ^eAcher\to be 
most inadequately emphasized in *fieir pre-serfice training 

• the Mmistrv of Education should revise certification guidelines 
' to reflect tpe above 

Recommendations Further 
[Recommendaildn^S 1 

I— — — — . — ^ 

That the Ministry of Education establish safety stand^>i:is for 
school science classrooms and provide funds for scho^aTaistri&iS 
not only to conduc^t surveys of the science safety equipment in 
schools where science is taught but also to correct deficiencies 
that may be discovered thtough i>uch surveys 



Becommendation 4 



\ Rocom^nendailon 5 \ 

That SQhool districts 

• evaluate the form of science coordination within each school 
and^estciblish some fumi of i>Lhool level coordirjcition ^hd'e 
none now exists 

• ^ not currently providmg science coordination appoint or desig- 

nate a qualified imfividLjal oi mdivixiuals to be ru^punsiblc for 
CQOidmahon ^and leddei ship of thh sc/enc e prugrdin^ wAhtu 
*the district 



Recommendation 6^ ' ' 

That school districts » . 

• investigate the potentia^for converting some existing element- 
ary gener^ classrooms into rooms with adequate scjence 
facilities f 

• examfne elementary schools for ways to utilize available space 
so that central storage and pfeparation space is available for 
science teaching I 

• attempt to provide for adequate ventilation storage space for 
\^latiles increased general storage space for equipment and 
increased space for storage of pupil projects where these are 
needed in schools^ ^ ' * 

• examine the quantity and quality ol the materials and equip- 
ment used in their sx^ience programs and make a determined 
effort to effect improvemer^ts where these are necessary 
especially m elementary schools and small junior secondary 
sciiools 

• encourage school libraries to purchase an adequate supply of 
science reading materials in both elementary and secondary 
schools 



Recommendation 7 



That wherever possible school districts and administrators 
avoid assigvH^g teachers with Ifitle science background to teach 
science in' junior secondary grades Where teachers must be 
reassigned outside then specialty provisions should be made for 
retraining , /j^ • 



Recommendation 8 



That scboo/ administrators and teachers' follow tt^ie time 
allocations given for science instnjction in the Administrative 
Handbook 



I Recommendation 9 



That teachers and school librarians cooperatively explore the 
upgrading of print materials in libraries and classrooms at both the 
elementary and secondary levels * 



[ Recommendation 10] 



That junior secondary teachers gtve greater time emphasis to 
earth science topics 



That the Curriculum Oevelooment Branch tne Ministry ofj 
Education establish Senior Secondai^y B'Olog/Revtsrjn Cof^^mit'- 
fee to re-examine all aspects of the senior secondary biologv 
curriculum 



Recommendation 1 1 



That science teachers 
' ensure that pupils understand safe procedures appropriate to 
their level 

give pupils more practice in presenting results irij^ymbolic 
forms (especially graphs) and in iriterpretmg such forms 
^gtve extensive time (particularly in elomer^ary schools) and 
emphasisjo measurement and quantification skills and to the 
use of the metric system 

give pupils If) upper elementary grades and secondary schools 
adeqljate experience m analyzing variables and designjng 
controlled experiments 

givamoro emphasis to teaching the practical applications of 
science knowledge and to using that knowledge m new 
Situations , 



ERIC 



9. WHAT HAPPENS NEXT? 



Results of the 1982 Sc lence.Assessment are now available for use Some examples of ways the results will be used are 

: ^ ' ,1 ' 

PROVINCIAL LEVEL 

I of a new curriculurr 



This assessment preceded the introduction of a new curriculum 
junior secondary science, and follows a revised curriculum in elementairy 
science This as^sment has provided baseline data which will be used r 
future assessnneTits to help judge effectiveness of the new curwcula 



QUESTIONS 

Any individual or group desiring clarification, discussion, assistance or) 
<w,ro r^r. on., o.^^.* ♦u^ — should contact the Learriing 



, advice on any aspect of the assess 
i Assessment Branch 
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Curricufum goal^ and assessment domains 

The circled areas in the above chart indicate assess- 
ment domains selected from the full range of curriculum 
goais stated m the curnculunn 

• not specifically listed as curriculum goals 



OTHER LEVELS 

Other groups which will find the 
Assessment results a source of important 
and relevant information inclade School 
I Districts, local teachers'^associations. 

professionarl development groups, and 
I teacher educators Interested groups 
.should examing^lhe reports and 
, Vecommendatip(i^>and submit their 
I. reactions to the Ministry , - ' 



The GENERAL REPORT an(r the- 
SUMMARY REP.ORT of th^> Science Assess- 
. ment were releas^ed November 1982 The 
SUMMARY REPaRT.presents higfilights of 
ihe project sunv^^cUv tablp>s <Df irTiportant 
r^^suits and conclusions ^nd recommernda- 
tions w^af" oy tn^ CorUract Team 

The SUMMARY REPORT was distributed- 
to school district oiiices m sufficientquanti- 
'ttea to provide one copy ta each school 
Copies were aiso sernt to universitios and 
^colleges ana to othdr edu^atipnal institu- 
tions , " / , 
• > 

The GENERAL RE PORT includes chapters 
detailing achievenient results teacher 
questionnaire results and the conclusions 
and recommenrjdfions Uow the Contract * 
TfMfTi In-'depth discussion of dataoccurs in 
each chapter The distribution of the 
GEKlE^RAL REPORT is limited becatise of ' 
the tpchnicai nature* of its contents , 

Aoditional copies of 'these reports^, 
hmitf'd numbers arp' avaiTaf^le along wifh " 
^Klditional inforrnatinri fj nni ^ 

LEARNING ASSESSMEN"^ BRANChf 
Munstry of Etiiicatiun 
7451 Eln>hndo^^ Way 
^RichfTKKid C V6X -^ 
(604 ( ?78~'^431 
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PROVINCE OF BRITISH COLUMBIA 

^ Ministry of Education 
^ '.""Schools Departmer^t 
Frpgrams Division 
Learning Ass^es3nrief]t^'Bfanch^, 
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